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Abstract 

Statistical inference on graphs is a burgeoning field in the applied and theoretical statistics commu- 
nities, as well as throughout the wider world of science, engineering, business, etc. In many applications, 
we are faced with the reality of errorfully observed graphs. That is, the existence of an edge between 
two vertices is based on some imperfect assessment. In this paper, we consider a graph G = (V, E). We 
wish to perform an inference task - the surrogate inference task considered here is "vertex classification" . 
However, we do not observe G; rather, for each potential edge uv £ (X) we observe an "edge-feature" 
which we use to classify uv as edge/not-edge. Thus we errorfully observe G when we observe the graph 
G = (V, E). Moreover, we face a quantity/quality trade-off regarding the edge-features we observe - 
more informative edge- features are more expensive, and hence the number of potential edges that can 
be assessed decreases with the quality of the edge-features. We derive the optimal quantity /quality 
operating point for subsequent graph inference in the face of this trade-off. 
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1 Introduction 



In areas as diverse as connectomics, where vertices may be neurons and edges indicate axon-synapse-dendrite 
connections, and social networks, where vertices may be people and edges indicate communication activity, 
statistical inference on graphs is becoming essential to scientific, engineering, and business activity. However, 
in many of these applications edges cannot be directly observed and instead we must infer their existence 
based on auxiliary edge-features. This reality gives rise to errorfully observed graphs, and the trade-off 
between more informative but more expensive edge-features and less informative but less expensive edge- 
features is of fundamental interest. (See the Appendix for a summary expounding upon the relevance of 
this trade-off for our two motivating applications.) We investigate optimal graph inference in the face of 
this quantity/quality trade-off, and demonstrate that the optimal quantity/quality operating point can be 
derived for a surrogate graph inference task. In the process, we also demonstrate that the optimal choice of 
edge-classifier for the subsequent graph inference task is not necessarily the Bayes optimal edge-classifier. 

1.1 Graph Preliminaries 

A graph is a pair G = (V, E) with vertices V = [n] = {1, • • • , n} and edges E C ( 2 ) ■ The adjacency matrix 
A is n x n, binary, symmetric, and hollow; A uv = 1 indicates an edge between vertex u and vertex v. 

A random graph is a graph- valued random variable G : O — >■ Q n , where Q n denotes the collection of 
all 2(2) possible graphs on V = [n]. A random graph model, denoted J 7 , is some specified collection of 
distributions on Q n . We write G ~ F& for some distribution Fq e T . 

A simple but interesting random graph model is the Stochastic Block Model, G ~ SBM([n], B, tt), intro- 
duced in Holland et al. (1983) and of continuing interest (Airoldi et al. (2008); Snijdcrs and Nowicki (1997); 
Wang and Wong (1987), etc.). Here the block connectivity probabilities are specified via the K x K symmet- 
ric matrix B with Bk 1 k 2 € [0, 1], and tt in the unit simplex A K specifies the block membership probabilities. 
Block membership is given by Y(v) ~ Discrete([K],Tr), and then A uv \Y(u),Y(v) ~ Bernoulli(BY( u ),Y(v))i 
yielding independent edges (conditioned on block membership). 

A practically useful and theoretically interesting generalization of the Stochastic Block Model is the Latent 
Position Model (Hoff et al., 2002). Consider first fixed latent positions Z e (R d ) n , and G - LPM{Z,t) 
where the link function £ : M. d x R d — > [0, 1]. Then A uv ~ Bernoulli{t(Z u , Z v )). Next, considering random 
latent positions, we have G ~ LPM(F,£), where Z~Fon (M. d ) n and A UV \Z U , Z v ~ Bernoulli(£(Z u , Z v )), 
yielding conditionally (on latent positions) independent edges. 

A random dot product graph model (Young and Schcincrman, 2007) is a special case of the Latent Position 
Model where the link function is the inner product and the latent positions are constrained so that their inner 
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product is always in [0, 1]; thus rdpg(Z) = LPM(Z, (•, •)) or rdpg(F) = LPM(F, (•, •)). For example, take F 
to be the joint distribution for an independent sample of size n from a mixture of <i-dimensional Dirichlets: 
/marginal = SfcLi 7r fe-C( r fc c ^fe + !)• Then let block membership be given by }^(u) ~ Discrete([K], it) and 
latent positions be given by Z v \Y(v) ~ -DfYy^-jd-y^,) + 1). Finally, A UV \Z U , Z v ~ Bernoulli((Z Ul Z v )). 
This provides a useful Wocfc signal continuum: when = for all fc there is no difference among the blocks, 
while minfe — > oo yields the if-block Stochastic Block Model (when all ctk are distinct). 

1.2 Inference Preliminaries 

Our goal is graph inference. We may wish to cluster vertices, or identify important vertices, or merely 
perform exploratory data analysis on the graph, looking for interesting structure. For concreteness, we 
assume that vertices are labeled as belonging to one of K vertex classes (e.g., professors, postdocs, students, 
etc.) and that we know these vertex class labels for some subset of vertices. In this case, we wish to classify 
the unlabeled vertices (based on connectivity structure). See Figure l(left). One common methodology 
for vertex classification is to embed the graph into finite-dimensional Euclidean space and employ standard 
classification methodologies. See Figure 1 (right). 




-2.0 -1.5 -1.0 -0.5 0.0 

Embedding Dimension #1 



Figure 1: Illustrative graph inference task: vertex classification. Left Panel: Vertices are labeled as belonging 
to one of K = 2 vertex classes - red and green. We know these vertex class labels for all but one vertex - 
black. We wish to classify this one unlabeled vertex (based on connectivity structure). Right Panel: Once the 
vertices are embedded in E 2 (shown here: adjacency-spectral embedding), the to-be-classified black vertex 
is easily classified as "red". 
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The embedding depicted in Figure 1 is an adjacency-spectral embedding, 1 the direct embedding of the 
adjacency matrix A, which is particularly appropriate for the random dot product graph model, as considered 

in Sussman ct al. (2012a) and Fishkind ct al. (2012). Sussman ct al. (2012b) demonstrates that Z = 
argmin Zg ( R< i)„ \\A — ZZ T \\p admits universally consistent classification (Dcvroye et al., 1996) for random 
dot product graphs. 

However, in this paper there are two classification tasks to be considered. The ultimate exploitation 
task is graph inference. The surrogate inference task considered here is "vertex classification" ; that is, we 
consider vertex class labels Y(v) ~ Discrete([K],Tr) and attempt to recover the unobserved vertex class 
label for distinguished vertex v* £ [n] based on the observed vertex class labels for v £ [n] \ {v*} and the 
observed graph G = ( [n] ,E). In addition, the errorful nature of our graph observation process induces 
an edge-classification task; we do not observe E but rather edge-features X{uv) for each potential edge 
uv £ ('"') from which we must infer E, and subsequent graph inference depends on this edge-classification. 

1.3 Outline 

In Section 2, we present a model for errorfully observed graphs which admits investigation of the quan- 
tity/quality trade-off. In Section 3, we develop a simple but illustrative surrogate inference task. In Section 
4, we demonstrate that the optimal operating point for the quantity /quality trade-off can be identified for 
our inference task. We conclude in Section 5 with a discussion of the implications of this work. 

2 Errorfully Observed Graphs 

For each potential edge uv £ ('■"■') we observe A"-valued edge-feature X(uv). These features may be as 
complex as "all the information regarding all interactions between actors u and v" - for instance, electron 
microscope imagery of axons and dendrites for neurons u and v or the text of all emails twixt adresses u and 
v. We will assume for simplicity that the X's take their values in [0, 1]. In both connectomics and social 
networks, for example, this is often a reasonable assumption: "Peters' rule" (Braitcnbcrg and Schiiz, 1991) 
suggests that the probability of synapse is proportional to axon/dendrite proximity; topic models (see Blci 
(2012) for a recent survey) estimate the proportion of topic "sports" (say) for each text document, and then 
the graph of interest is "who talks to whom about sports." 

1 There are many graph embedding techniques, with perhaps the most popular being various instantiations of the Laplacian 
eigenmap (see, e.g., Bclkin and Niyogi (2003)); we shall not be concerned in this paper with the comparative properties of graph 
embedding techniques. 
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Let G ~ Fg for some graph distribution Fq. Let p — p(Q) = E[\E\/(£)] denote the probability that an 
arbitrary uv G ) is an edge in the (random) graph; that is, the expected graph density. We let Y(uv) 
represent the true class labels for the potential edges 2 . Then, for Y(uv) = y G {0, 1}, the class-conditional 
distributions F X ( lLV )\Y(u V )=y = Fy govern the edge-features, and we assume X(uv)\Y(uv) = y ~ F y . That 
is, the edge- feature distribution for potential edge uv depends on only Y(uv) (edge/not-edge). We write the 
edge- feature marginal Fx = (1 — P)Fq + pF%. 

At this point we can identify the Bayes edge classifier based on the edge-feature marginal - we assume 
for simplicity that the class-conditional edge- feature probability density functions /o,/i exist - given by 
9Bayes(X) = I{pf\(X) > (1 — p)fo(X)}. This results in the random graph GsBayes, whose distribution is 
induced by Fq, Fq, and F%. (NB: Edge classification is not the ultimate exploitation task. Rather, edge 
classification is an enabling step for subsequent (errorful) graph inference. The optimality of gsayes for this 
subsequent inference will be addressed in the sequel 3 .) 

However, we also have a quantity/quality trade-off: more informative edge-features are more expensive. 
To further simplify our presentation, we will assume that the [0, l]-valued edge-features Xo ~ Fo and X\ ~ F\ 
satisfy the stochastic ordering condition Xo <st -Xj.; that is, larger values of the edge-feature X(uv) indicate 
that the potential edge uv is more likely truly an edge. In light of this assumption, we will consider the 
collection of edge-classifiers given by g T (X) = I{X > t} for threshold r G [0,1]. To capture the idea 
of our quantity/quality trade-off, we index the class-conditional edge-feature distributions Fo K ,Fi lK with 
the quality index k G (0, oo) such that larger k implies more informative edge-features. There are natural 
stochastic ordering conditions characterizing our trade-off: (a) X k <st -Xi « for all k, and (b) K\ < k 2 
implies Xq_ Ki >st ^o,k 2 an d Xi^ Kl <st -Xi,« 2 • Now we introduce the quality penalty function h : K + — > [0, 1] 
(decreasing) and specify that we actually classify only 100-/i(k)% of the potential edges 4 , so that larger k 
implies more informative but more expensive edge-features and hence fewer potential edges actually classified. 

This framework results in the following errorfully observed stochastic block model. Assume that G ~ 
SBM([n], B, 7i"). Write the collection of potential edges uv as the disjoint union of edges (uv G E 
Y(uv) = 1) and non-edges (uv G E Y(uv) = 0); thus ( [l 2 l1 ) = E U E. The event {uv G E} - 

that is, that the potential edge uv is classified as being an edge - depends on r through the classifier 

2 We will use Y to denote the class label for both classification tasks to be considered; it will be easy to distinguish between 
Y(v), a class label associated with a single vertex, and Y(uv), a class label associated with a pair of vertices (i.e., a potential 
edge). 

3 Note that we are assuming that we must binarize edges; that is, subsequent inference will be performed on a (simple) 
graph. 

4 We assume that the potential edges not classified at all, due to the quality penalty /i(re), are Missing Completely At 
Random (MCAR). 
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Y(uv) = g T (X(uv)) = I{X(uv) > r} and on n and Y(uv) through the class-conditional edge-feature 



distribution Fy( U v),k- Given class-conditional edge-feature distributions Fq jK and Fi fK and r G [0, 1], we write 



GiJt) = P T , 



uv G E I uv € E 



1 — F 1k (t) for the probability that a potential edge that is truly an 



uv G E I ?iw G .E 



1 — Fq !K (t) for the probability 



edge is correctly classified as an edge and Gq iK (t) = P T , K 
that a potential edge that is truly not an edge is incorrectly classified as an edge. This would characterize 
our errorfully observed graph, except that we must also account for the quality penalty h : (0, oo) — ¥ [0, 1], 
decreasing, for k G (0, oo). Incorporating this penalty, we obtain B = h(n) [Gi jK (t)B + Go, re (r)(J — B)], 
where J is the K x K matrix of all l's, and thus the resultant errorfully observed graph distribution is given 
by G ~ SBM([n], B,tt). Note that G and B will always depend, implicitly, on k and r. (This formulation 
assumes that the potential edges not classified at all, due to the quality penalty h(n), are set to - i.e., 
non-edge. This choice of dealing with missing values for the potential edges will be revisited later.) 



3 Vertex Classification 

Given graph G = ([n],E) with vertex class labels y(v) G [K], there are many methodologies available for 
estimating the unobserved vertex class label for distinguished vertex v* G [n] (recall Figure 1). We will 
proceed with perhaps the simplest nontrivial vertex classification approach; later, we will see that we can 
optimize this classifier for r and k in the errorfully observed stochastic block model. 

First, for each k G [K], we count the number of class k vertices ilk — J2 v e[n]\{v*} I{v( v ) = Next, we 
calculate the fc-degree of v* - the number of class k vertices that are connected to v* - given by dk{v*) = 
S«e[n]\{«*} = fc } ' I i vv * e E}. Finally, we classify v* via j(v*) = argmax fc d k (v*)/n k . 

The classifier 7 makes perfect sense for an affinity stochastic block model - that is, a stochastic block 
model with B k k > Bkk' for each k and for all k! 7^ k: assume that G ~ SBM([n], B, ir) with B satisfying the 
affinity conditions and that v* is chosen uniformly at random, and see that D k {v*) / N k ~ B k Y(v')- (Here we 
have written D k {v*) and N k for the random variable versions of d k (v*) and riy. defined above.) 

Define L — P[-f(v*) ^ Y(v*)\G, {Y(v)} V E[n]\ {v*}] to be the probability of misclassifying vertex v* using 
classifier 7 (Devroye et al., 1996). A simple conditioning argument yields the following result. 

Let G ~ SBM([n), B,tt) be an affinity stochastic block model graph. Let the classifier 7(1;*) = 
argmax fe Dk(v*)/Nk- Conditional on [JVi , •■ • ,Nk] = [ni,--- ,tik] &ndY(v*) = k, the binomials Bin{n\, B^i), 
Bin(riK,BkK) are independent. Thus the probability of misclassification with no ties is given by 
P[Bin(nk, Bkk) /n-k < maxfe/j^ Bin(rik' , Bkk')/nk']', the probability of misclassification in the case of ties, 
given by Tk, depends on the tie-breaking procedure. Therefore, the probability of misclassification is given 
by 



G 



L = Ph(v*)^Y(v*)\GAY(v)} ve in]\{-o*}} 

/ i \ K K / 

niH hn K =n-l v ' ' ft/ fc=l fc=l v 

where the first summation, for the multinomial, is over all non-negative integer partitions of n — 1 into 
[ni, ■ ■ ■ , rife]. (The convention ~ = must be adopted for the cases in which some n k are 0.) 

In the next section we optimize the classifier 7 for r and k in the errorfully observed affinity stochastic 
block model. 



Bin(n k ,B kk ) Bin(n k > ,B kk >) 

< max 

n k k'^k rift/ 



+ T k (1) 



4 Optimizing the Quantity/ Quality Trade-Off 

Let G ~ SBM([n], B,tt). Recall that the distribution of G depends on the original block connectivity 
probability matrix B and on n and r (and hence on the quality penalty function h and on the class- 
conditional edge-feature distributions Fq^ k and Fi tK ), although this has been surpressed notationally. Notice 
also that if SBM([n], B,ir) is an affinity stochastic block model graph, then so is SBM([n], B, ir), because 
the edge-feature distribution for potential edge uv depends on only Y{uv) (edge/not-edge) and does not 
otherwise depend on the block memberships Y(u) and Y(v). 

Define L K , r = P[j(v*) 7^ Y(v*)\G, {Y(v)} ve [ n ]\{ v *y] to be the probability of misclassifying vertex v* 
using classifier 7 for G with a fixed k and r. Eq. (1) applies, replacing the binomial parameters B klk2 
with B klk2 . Thus the optimal (quality penalty parameter k, edge-classification threshold r) pair for the 
subsequent vertex classification graph inference problem using classifier 7 is given by 



(/c",T") = argmin £ ( " " 1 ) f[ <■ f n ( P 

' m+-+n K =n-l V L ' ' K/ k=l k=l \ 

4.1 Demonstration 

Here we present a simple but illustrative demonstration of Eq. (2). Let SB M([n], B, n) be a stochastic 
block model with K = 2, tt = [1/2,1/2]' and B satisfying 1 > B n = B 22 > B 12 = B 21 > 0. Note 
that B satisfies the affinity SBM conditions. We let the class-conditional edge-features be governed by 
Beta distributions: Fq )K — fi 2 . K and Fi lR = f3 K . 2 . Note that for k S (2, oo) these distributions satisfy our 
stochastic ordering conditions, and that n = 2 yields useless features and larger k yields more informative 



Bin(n k ,B kk ) Bin(n k < , B kk >) 

< max + 1 k 

n k k'=£k n k i 

(2) 
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features. Recall that the collection of edge-classifiers considered is given by g T (X) = I{X > t} for r 6 [0, 1], 
and notice that tt = [1/2,1/2] and B doubly stochastic implies that the expected graph density p(G) = 
(mr T Bit — l T diag(B)ir) / (n — 1) = ((n/2) — b)/(n — 1) w 1/2 and hence, since /q k and f l K are reflections 
about 1/2 of one another, TBayes ~ 1/2 for all k. The quality penalty function considered is h{n) = (2/k) 3 , 
so k — 2 yields classification of all edges, and while larger n yields more informative edge- features, fewer 
edges are actually classified. We consider G ~ SBMQn], B, tt) to be the associated errorfully observed graph 
(again, depending on k and r). For further simplicity we condition on N\ = N2 and thus n = n\ + n 2 + 1. 
For this demonstration the classifier 7 simplifies, yielding 

7(«*) = argmaxDfc^*) = 1 + I{D 2 (v*) > D^v*)} 

k 

with Dk(v*) ~ Bin(n,k, BY( v *),k)- Thus the probability of misclassification L KjT simplifies to 

i K ,r = ^2 fBin{i;ni,B ia )F Bin {i - l;ni,B 1A ) + (1/2) ^ "1, Bi !2 )f Bin (i; m, -B 1;1 ). 

i=l i=0 

(Here, with if = 2 and conditioning on = A^, the sensible tie-breaking procedure "flip a fair coin" is 
explicitly accounted for in our expression for L K T .) 

Figure 2 depicts the error surface L K T for this demonstration, with n = 51, £>n = B22 = 0.9 and 
B12 = B 2 i = 0.1. The z-axis - probability of misclassification L 6 [0,1], depicted via color and level 
curves - represents performance on our vertex classification task. The y-axis - r S [0,1]- represents the 
classifier used to obtain E. The x-axis - k £ [2, 00) - represents the quality of the edge-features we observe - 
larger n implies more informative but more expensive edge-features and hence fewer potential edges actually 
classified. For this case, (k*,t*) (3.5,0.6) and L K *. T * ~ 0.161. The figure represents this quantity/quality 
trade-off, and also demonstrates that the optimal choice of edge classifier is not the Bayes optimal classifier 
(TBayes ~ 1/2 for all k) . Indeed, using TBayes rather than r* results in a substantial relative performance 
degradation of more than 10%, from L K * T * « 0.16 to argmin K L K TBayiia « 0.18. Figure 3 explains this 
phenomenon by examining the (-Bi,2> -Bi.jJ-path for fixed n — k* as t varies from to 1. 

4.2 Large Sample Approximation 

For large n, the objective function for minimization in Eq. (2) can be approximated: Binomials become 
Gaussians. For illustration, we present the optimization problem for the simplified expression for L KT 
available for our demonstration. In this case, the large sample approximation optimization problem can be 
written in terms of the SBM block probabilities B\\ and B\2'- 
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Figure 2: Demonstration of optimal inference for errorfully observed graphs: (k*,t*) (3.5,0.6) and 
L K * jT . sa 0.161. See Section 4.1 for details. 



Maximize ^(k, r) = c/y/ci + c 2 — C3 
where c - ^(fl u - S 12 )(G liK (r) - G , K (r)) 

and c x = (Bn + B u )(l - 2/i(k)(Gi, k (t) - G 0) k(t))G 0iJ( (t)), 

c 2 = 2G , k (t)(1-/i(«)G ! o,«(t)), 
c 3 = (fl? a + £? 2 )%)(G 1)K (t) - G , k (t)) 2 . 



We write (k, t) = argmax ^(k, t) and L^,? = y/nii^C^, ^))- For example for fixed re, the large sample 
approximation r for the optimal threshold r* for subsequent classification via 7 is easily obtained. Figure 4 
presents the result for our demonstration setting. 



4.3 Minimizing Projection Error 

Spectral embedding methods proceed by finding a low-rank latent space representation (projection). In 
the case of SBM([n], B, it) with rank(B) — d, standard results from perturbation analysis (e.g., Davis 
and Kahan (1970)) demonstrate that (re, r) = argmin K T maxfe(7ri?)fe/A^, where the numerator (irB)k is the 
k th element of the if-vector (irB) and the denominator is the square of the d th largest eigenvalue of 
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Figure 3: The (i?i,2, -Bi,i)-path for fixed n — k* as r varies from to 1. The axes represent the 
possible parameter values for the two binomials in the simplified expression for L KjT available for our 
demonstration. The color and level curves represent L(po,pi) = Yli=i /sin(*j 25,po)-Psm(* — l>25,pi) + 
(1/2) X)?=o /sm(^) 25,po)/sin(*; 25, pi). The left panel is the full parameter space; the right panel is a zoom- 
in of the (Bi,2, -Bi,i)-path. This figure illustrates why the optimal r* (the big black dot) ^ Ts a yes (the little 
black dot): the curvature of the {B\^ : Si : i)-path does not match the curvature of the level cuves of L(po,pi). 

the K x K matrix (diag(n)B), minimizes (with high probability) an upper bound on the projection error. 
Experiments indicate that this simple indirect method yields results consistent with our exact solution - 
that is, (k, t) fa (k*, t*). In particular, for our simple demonstration case, this approach is equivalent to our 
large sample approximation (/?, r). 

5 Conclusions 

We have presented a simple model for errofully observed graphs derived from classifying potential edges based 
on observed edge-features. For this model, we have investigated optimal vertex classification in the face of 
the quantity /quality trade-off: more informative edge-features are more expensive, and hence the number of 
potential edges that can be assessed decreases with the quality of the edge-features. Considering a simple 
vertex classification rule, we have derived the optimal quantity/quality operating point and demonstrated 
that the Bayes optimal edge-classifier is not necessarily the optimal choice of edge-classifier for the subsequent 
graph inference task. 
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Figure 4: Large sample approximation for our demonstration setting with k* = 3.5. (NB: n = 51 <C oo.) 
The black solid curve is analytic L K * T , The green curve dashed is the large sample normal approximation 
L K , <T , Result: T Bayes « 1/2; r* w 0.600; r w 0.604. 

5.1 The Surrogate is Instructive 

The vertex classification methodology we have investigated is perhaps the simplest nontrivial approach. In 
particular, we have so far shirked any methodology based on the common approach to general graph inference 
of first embedding the graph into finite-dimensional Euclidean space and then addressing inference therein. 
The reason for this is a clear self-indictment: we are so far unable to directly analyze the quantity/quality 
trade-off for statistical inference on errorfully observed graphs in any such methodology. 

We do, however, have a wealth of empirical evidence suggesting that our surrogate optimization yields 
results that can be profitably used to choose the («, r) quantity/quality operating point for these "inference 
composed with embedding" methodologies. Figure 5 presents one illustrative empirical result supporting 
this claim. For our demonstration setting, we employ the adjacency-spectral embedding (see Figure 1) and 
use Fisher's Linear Discriminant (Duda and Hart, 1973) for the two-class classification in R 2 . For any fixed 
(k, t), Monte Carlo yields the estimate L K:T of probability of misclassification. 

5.2 The "Missing" Model 

The formulation we presented in Section 2 for errorfully observed graphs G ~ SBM([n], B, it) assumes that 
the potential edges not classified at all, due to the quality penalty h(K), are set to - i.e., non-edge. In 
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Figure 5: For our demonstration setting we see that the surrogate optimization is instructive regarding more 
elaborate graph inference: the black solid curve is analytic L K *y, the green dashed curve is the large sample 
normal approximation £ K » jT ; the red dotted curve is Monte Carlo L K * . T . (NB: standard error bars are hidden 
within the red dots!) Result: T Bayes « 1/2; t* « 0.600; f w 0.604; r w 0.610. 

fact, in many use cases we might expect to have full knowledge of which potential edges have been classified 
as non-edges and which potential edges have not been classified at all, and it seems sensible to treat these 
latter as "missing." (Recall that we assume that the potential edges not classified at all are MCAR.) 

This "missing" model is specified as in Section 2, but with two important alterations. First, while 
B = h(n) [G hK {r)B + G , re (r)(J - B)\, we consider B M CAR = G hK (r)B + G , k {t)(J - B). That is, the 
quality penalty H{k) does not impact the errorful block connectivity probability matrix Bmcar- Then we 
consider Gmcar ~ 

(SBM({ 

n ]i Bmcar, tt) J , where s p {F&) for p £ [0, 1] and for some graph distribution 
Fq indicates random sampling of potential edges; the potential edges not sampled through s p are left as 
missing entries in the adjacency matrix A. (Contrast this with the notionally similar SBM([ny^h(K)], B, n).) 

For &mcar we obtain analogous optimization results to those presented in Section 4 above. In fact, we 
consider the random graph G analyzed herein to be an instantiation of G mcar with the missing values im- 
puted to be 0s (non-edges). Of fundamental interest is the quantity/quality optimization for more elaborate 
imputation schemes. 
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5.3 Discussion 

Alas, we do not know the block connectivity probability matrix B or block probability vector w. (And of 
course we are not really facing a stochastic block model . . . but in many applications - e.g., connectomics 
& social networks - a stochastic block model can be a productive (if overly simple) first model.) We note 
that, for a given k, one can obtain estimates of B and tt from the available {X(uv)} and {Y(v)}, assuming a 
parametric form for the class-conditional edge-feature distributions F k and F\,k- Nevertheless, our primary 
purpose has been to present a foundational analysis of the quantity/quality trade-off for errofully observed 
graphs and to demonstrate the folly of fixating on the optimization of the edge-classifier for edge-classification 
performance when susbsequent graph inference is the ultimate goal. 

Appendix 

Connectomics 

Connectomics is a bourgeoning field in which investigators estimate brain-graphs (connectomes) for sub- 
sequent inference tasks. For example, Electron Microscopy (EM) connectomics investigations explore hy- 
potheses of conditional independence between vertices (Bock et al., 2011), and Magnetic Resonance (MR) 
connectomics often use brain-graphs as biomarkers for phenotypic variability (Vogclstcin ct al., 2012). Re- 
gardless of the experimental modality or subsequent inference task, connectomics investigators always face 
quantity/quality trade-offs with regard to graph inference. These trade-offs arise in at least two stages of 
the analytics pipeline: (1) data collection, (2) data analysis. In particular, in EM connectomics, different 
experimental paradigms admit different spatial resolutions for the same imaging time (Briggman and Bock, 
2012), yielding a number of distinct re's. Regardless of the chosen imaging modality, manual, semi- or fully- 
automatic tracing algorithms are then employed to infer the graph from the noisy image data (Briggman 
and Denk, 2006). Each edge, therefore, can be endowed with a confidence level, which corresponds to the 
edge-features of interest described above. Similarly, in MR connectomes, different scanner sequences yield 
higher spatial resolution, but therefore reduce the signal-to- noise ratio per voxel (Haacke et al., 1999). Given 
the noisy MR connectomics data, "tractography" algorithms estimate connectivity amongst brain voxels 
(Gray ct al., 2010). Again, each edge can be endowed with a confidence. Historically, for any connectomics 
investigation, the threshold for counting an edge as "real" has been ad hoc, at best. Priebe ct al. (2012) 
presents a first principled treatment of this issue. This manuscript suggests that we can choose both r and 
re to optimize our subsequent inference task. 
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Social Networks 

Social network analysis is another bourgeoning field in which the data are represented via a graph. In this 
setting, vertices (actors) represent individuals and edges (links or ties) typically represent communication 
between pairs of actors. A classic example is the Enron email graph (Priebe et al., 2005). For these data, we 
place an edge between a pair of actors according to whether an email was exchanged between the pair. Both 
the vertices and edges can be endowed with complex attributes. For example, edges may be attributed with 
a word-count vector, in which each dimension corresponds to a unique word. The dimensionality of these 
attributes, however, is exceedingly large. We can reduce the edge attribute dimensionality via topic modeling 
(Blei ct al, 2003; Deerwester et al., 1990; Papadimitriou et al., 2000). Topic models learn a set of "topics" 
associated with each document (in this case, an email message). Topic modeling objective functions also tend 
to be computationally demanding. Therefore, a number of approximations are typically employed to obtain 
approximately optimal solutions that scale up to very large data, including variants of online variational 
Bayes (Hoffman ct al., 2010), stochastic gradient descent (Mimno ct al., 2012), latent factor modeling (Zhou 
ct al., 2012) and parallelization schemes (Ahmed et al., 2012). Each of these approaches makes important 
approximation/computation trade-offs, which are not currently understood very well (Asuncion et al., 2012) 
- especially in terms of subsequent inference. Recalling the Enron email example, we may be interested in 
inference based on only those email messages with certain key topics, such as sports (or insider trading). 
But assessing which emails contain the interactions of interest is a "Human Language Technology" (HLT) 
problem. The computational trade-offs associated with MCMC and variational Bayesian methods, for ex- 
ample, induces a quantity/quality trade-off for assigning edge features. Specifically, we can invest more or 
less HLT time per edge, from manual investigation (humans reading the messages) to simple keyword search: 
more expensive HLT will yield more accurate topic estimation, but at the cost of fewer messages assessed, 
while less expensive HLT will yield less accurate topic estimation, but for a larger number of messages as- 
sessed. The ability to determine the optimal operating point for this quantity/quality trade-off for a given 
computational budget will lead to superior subsequent inference for a wide variety of social network analysis 
tasks. 
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